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It  has  been  about  20  years  since  the  first  papers  in  AJ.  appeared.  In  this  period,  AJ.  research 
has  produced  many  interesting  idess  of  which  list  processing  la  probably  the  moat  widely  used. 
Other  results  of  AJ.  research  include  chess  programs,  etc.  Progress  has  been  slower  than  some 
people  predicted.  Therefore,  there  has  developed  a body  of  literature  which  claims  that  AJ. 
effort  is  misguided.  In  this  paper  I will  reply  to  three  prominent  critics  of  AX,  Dreyfus, 
Weizenbaum,  and  Lighthill. 
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It  has  been  about  twenty  years  since  the  first  papers 


produced  many  interesting  ideas,  of  which  list  processing 


is  probably  the  most  widely  used.  Other  results  of  artificial 


intelligence  (A. I.)  research  include  chess  programs  (16) 


which  derives  a molecular  structure  from  a spectrogram  (8) 


consequence,  there  has  developed  a body  of  literature  which 


claims  that  the  entire  A. I.  effort  is  misguided.  In  this 


Dreyfus,  Weizenbaum,  and Lighthill.  Although  I find  little 


or  philosophy,  is  a difficult  enough  endeavor  that  it  can 


I will 


was  by  Hubert  L.  Dreyfus,  as  described  in  his  book  What 


Computers  Can ' t Do  (6) . Dreyfus  is  a philosopher  who 


Section  Jg 
iection  □ 


specializes  in  existentialism  and  phenomenology.  Although 


he  has  read  extensively  in  computer  science,  Dreyfus  does  not 


seem  to  have  the  detailed  technical  expertise  which  comes 


from  actually  performing  computer  research.  He  makes  a 
Not*:  Manuscript  submitted  Dscimbsr  14,  1978.  | - 
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complicated  argument  which  will  only  be  sketched  here 


He  lists  several  characteristics  of  human  thought  and  claims 


that  they  cannot  be  replicated  in  a "step-by-step"  computer 


In  particular,  he  claims  that  computer  behavior  is  "rule 


like"  in  a way  that  human  behavior  is  not.  He  illustrates 


intuitive  horse  player  who  goes  by  guess  and  the  Racin 


Form  (5).  Intuitive  horse  playing  is  claimed  by  Dreyfus  to 


be  an  "UHFIP 


or  "Uniquely  Human  Form  of  Information 


that  Dreyfus  falls  into  a philosophical  trap  by  failing  to 


distinguish  between  two  senses  of  the  notion  "behavior 


In  an  obvious  sense,  the 


while  the  intuitive 


In  a second  sense,  the  behavior  of  the 


intuitive  player  can,  in  theory,  be  described  in  terms  of 


the  laws  of  psychology  and  neurophysiology,  although  of 


course  we  do  not  know  these  laws  well  enough  to  predict  the 


intuitive  horse  player's  behavior.  A rule  of  type  I is 


something  adopted  by  people  as  a guide  for  conduct,  such 


as  an  ethical  code.  A rule  of  type  II  is  a law  of  nature 


which  describes  the  behavior  of  a (living  or  non-living) 


thing.  Thus  the  motion  of  the  planets  is  rule-like  in  the 


sense  of  type  II  but  not  rule-like  in  the  sense  of  type  I 


The  notion  that  we  humans  are 


by  the  laws  of  nature  (rules  of  type  II)  is  the  foundation 


of  psychology  and  neurophysiology.  In  a second  argument 


Dreyfus  compares  the  brain  with  an  analog  computer. 


suggesting  that  digital  computers  are  stupid  because  of 


their  step-by-step  character.  But  a continuous  process 


degree  of  accuracy,  at  a considerable  price  in  speed  of 


computation.  Dreyfus  would  be  on  firmer  ground  if  he 


attacked  A. I.  based  on  philosophical  arguments  (e.g 


that 


machines  lack  consciousness  and  free  will).  It  is  ironic 


that  Dreyfus,  the  philosopher,  considers  the  technical 


question  of  whether  A. I.  can  be  achieved,  while  Weizenbaum, 


the  computer  scientist,  studies  the  ethical  and  political 


question  of  whether  A. I.  should  be  achieved 


If  Dreyfus  is  un-knowledgeable  about  computers,  the 


opposite  is  true  of  Joseph  Weizenbaum,  author  of  Computer 


Power  and  Human  Reason  (33).  Weizenbaum  is  a distinguished 


computer  scientist  and  inventor  of  the  well-known  Eliza 


program  (32),  which  carries  on  a rudimentary  conversation 


with  the  user.  The  crux  of  Weizenbaum' s argument  is  social 


and  political.  He  argues  that  computers  have  reinforced  the 


most  conservative,  indeed,  reactionary,  ideological  com 


ponents  of  the  (spirit  of  the  age)"  (34).  Making  frequent 


references  to  the  role  of  computers  in  the  Vietnam  war,  he 


argues  that  attempts  to  replace  human  reason  by  computers 


One  illustration  is  the  work  of 


Kenneth  Colby  (2)  in  applying  computer*  to  psychiatry. 

Anyone  who  has  visited  a large  state  mental  hospital  will 
testify  that  these  institutions  are  obscene  because  of 
under- funding  and  lack  of  adequate  therapy.  If  we  had  a 
way  of  getting  the  computer  to  carry  on  the  simplest 
conversation  with  a withdrawn,  institutionalized  patient, 
it  would  be  a blessing.  Weizenbaum  criticizes  this  work 
on  the  ground  that  it  is  obscene  to  replace  the  psychiatrist 
with  a computer;  after  all,  the  computer,  not  being  human, 
cannot  really  empathize  with  the  patient.  A more  cogent 
criticism  is  that  the  state  of  the  art  of  language  under- 
standing by  computer  gives  the  computer  hardly  a glimmer  of 
understanding  about  what  the  patient  is  saying.  Weizenbaum 
seems  to  be  making  a blanket  indictment,  not  only  of  A. I. 
research,  but  of  computers  in  general  and  society  as  a whole. 
Our  society  has  its  flaws,  but  this  does  not  mean  that  A. I. 
research  is  wasted  effort. 

Sir  James  Lighthill  is  a prominent  mathematician  who 
is  perhaps  best  known  for  his  work  on  generalized  functions (10) 
Lighthill  has  written  a critique  of  A. I.  (11)  which  at 
least  attempts  to  be  fair  (more  than  can  be  said  for  Dreyfus 
or  Weizenbaum).  Lighthill  divides  A. I.  research  into  three 
areas:  A,  B,  and  C.  A is  for  advanced  automation;  C is 

central  nervous  system  theory  and  simulation.  B is  the 
bridge  activity,  which  Lighthill  identifies  with  building 


robots . 


Li9hthi.ll  supports  research  in  advanced  automation, 
but  not  particularly  by  A. I.  researchers.  He  also  supports 
research  in  simulation  of  the  nervous  system,  but  emphasizes 
the  role  of  psychologists  and  neurophysiologists.  He 
criticizes  robot  research  as  unsound.  I agree  that  it  would 
be  desirable  if  psychologists  and  neurophysiologists  made 
more  use  of  computers.  But  behavior  modeling  needs  a very 
capable  programmer  with  a thorough  knowledge  of  heuristic 
methods;  it  places  quite  a strain  on  his  programming  ability. 
There  are  not  many  psychologists  and  neurophysiologists 
willing  and  able  to  write  this  type  of  program. 

Despite  Lighthill's  attack,  robotics  remains  the  best 
way  to  study  computer  interaction  with  the  world,  a key 
feature  of  intelligence.  The  robotics  studies  on  perception 
and  motor  control  rank  among  the  best  studies  of  these 
topics  in  any  branch  of  science  (33).  Lighthill  doesn't 
seem  to  grasp  the  need  for  basic  research  in  A. I.  which  can 
support  advanced  automation  and  brain  simulation.  Sutherland 
(29)  points  out  that  some  of  the  most  interesting  innovations 
which  have  come  from  A.Z.  came  from  the  bridge  (or  basic) 
area. 
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Having  criticized  the  critics,  Z will  now  turn  to  a 


much  more  important  activity:  criticizing  A. I.  itself. 

Why  has  progress  been  slow?  We  need  not  look  far  for  an 
answer:  Progress  is  slow  because  we  are  attacking  a very 

basic  and  very  difficult  scientific  problem,  that  of 
understanding  intelligence. 


Based  on  twenty  years'  experience,  what  are  the 
prospects  for  machine  intelligence?  I shall  begin  by 
dividing  the  set  of  all  problems  which  one  might  pose  for 
an  information  processor  into  four  categories:  Hardware 
problems,  ordinary  (programmable)  computer  problems,  a 
category  which  I will  call  "learnable  problems,"  and, 
finally,  unsolveable  problems.  Hardware  problems  are 
simple  enough  to  be  solved  with  logic  or  analog  components 
and  need  no  digital  computer.  Ordinary  computer  problems 
are  defined  as  those  for  which  it  is  practical  to  write  by 
hand  a program  for  solving  the  problem.  Learnable  problems 
are  those  which  it  is  impractical  to  program  by  hand  and, 
with  current  technology,  must  be  solved  by  people.  Un- 
solveable problems  can  be  solved  by  neither  man  nor  machine; 
an  example  is  predicting,  with  absolute  generality,  whether 
or  not  a computer  program  will  halt;  see  Minsky  (13). 


The  class  of  all  learnable  problems  may  be  subdivided 
into  two  categories:  The  problems  which  a computer  can 


learn  to  solve,  using  a few  thousand  dollars  worth  of 
learning  code,  and  those  which,  in  principal,  require  a 
person  to  solve  them;  I will  call  these  the  "person- 
requiring"  problems.  Examples  of  such  are: 

(1)  Fully  automatic,  high-quality  translation  of 
natural  languages. 

(2)  Equalling  human  ability  to  learn  from  experience. 

(3)  Equalling  human  ability  to  remove  ambiguities 
from  visual  and  speech  inputs. 

Readers  who  are  familiar  with  automata  theory  may 
object  to  the  idea  of  a "person-requiring"  problem  on  the 
ground  of  Turing's  thesis  (14),  which  asserts  that  any 
"well-defined"  procedure  can  be  carried  out,  in  principle, 
by  a class  of  machines  called  Turing  machines,  of  which  the 
digital  computer  is  an  example.  But  I shall  argue  that 
the  "person-requiring"  problems  cannot  be  solved  by  machines 
without  turning  the  machine  into  a person,  which  is  possible 
in  principle  if  Turing's  thesis  is  correct.  However,  to 
turn  the  machine  into  a person  is  far  beyond  the  state  of 
the  art,  to  the  point  of  being  science  fiction. 

Let  us  begin  by  comparing  people  and  machines,  viewed 
as  "information  processors".  It  is  common  sense  that 
computers  are  fairly  stupid  and  that  people  are  smarter. 

The  reasons  are  far  from  obvious,  indeed  far  from  being 
understood.  A.Z.  researchers  have  come  to  realise  that  one 
key  to  good  problem  solving  is  to  have  good  knowledge  about 
the  problem  and  the  methods  for  solving  it.  Part  of  the 


fairly  "brute- force , " inspecting  several  thousand  positions 
in  deciding  on  a move.  By  comparison,  a human  chess 
master  looks  at  100  or  fewer  positions.  Simon  and  Chase  (26) 
suggest  that  a human  master  can  recognize  and  deal 
appropriately  with  perhaps  50,000  different  types  of 
positions.  Current  hardware  is  probably  too  serial  and 
hence  too  slow  to  search  50,000  pattern,  even  if  we  could 
assemble  the  file  of  position  types.  There  are  algorithms 
such  as  hash  coding,  which  can  search  50,000  positions 
quickly.  However,  these  algorithms  color  the  search  process 
in  ways  which  may  be  undesirable. 

Future  historians  may  consider  that  the  importance  of 
A. I.  research  is  in  its  contributions  to  our  understanding 
of  human  though  and  behavior,  more  than  in  its  practical, 
technological  impact.  In  my  opinion,  the  best  research 
on  problem-solving,  planning,  vision,  and  learning  since 
1955  has  come  from  this  little-publicized,  much-criticized 
branch  of  computer  science.  There  are  signs  of  a rapproche- 
ment between  A. I.  and  cognitive  psychology.  A. I.  work  in 
language  understanding,  in  particular,  seems  to  be  influencing 
workers  in  more  traditional  fields. 

A basic  difficulty  with  A. I.  is  that  we  must  still 
program  the  computer,  telling  it  in  laborious  detail  just 
what  to  do.  The  cost  and  difficulty  of  programming  are 
serious  obstacles  to  practical  applications  of  A. I.  There 


is  only  the  most  primitive  technology  of  getting  the 


»w 


computer  to  learn  by  experience  how  to  do  interesting 
things  (9,28,31).  Machine  learning  is  an  old  idea  which 
never  got  very  far.  The  early  approach  was  to  get  machines 
to  learn  chess  playing  or  other  adult  behavior.  The 
approach  failed,  presumably  because  the  computer,  not  having 
been  to  "playpen  university,"  lacked  the  concepts  and 
methods  for  learning  adult  skills. 

Perhaps  the  best  approach  to  machine  learning  is  to 
try  to  program  the  machine  to  learn  perceptual  and  motor 
skills,  such  as  recognizing  objects  and  moving  them  around. 
Winston  (35)  has  written  a program  which  can  learn  to 
recognize  simple  objects,  such  as  arches,  by  generalizing 
from  correctly  labeled  examples.  The  pitfall  to  avoid  in 
studying  machine  learning  is  the  "bootstrap  from  nothing" 
syndrome  in  which  the  researcher  tries  to  give  the  computer 
no  information  at  all,  with  the  idea  that  the  machine  can 
learn  everything  for  itself.  Reference  (9)  describes  an 
approach  to  machine  learning.  The  idea  is  to  have  a 
repertoire  of  primitive  operations,  such  as  recognizing 
when  one  event  causes  another,  plus  learning  code  that 
senses  when  the  primitive  operations  can  profitably  be  put 
into  learned  program.  If  this  approach  proves  feasible, 
it  would  provide  an  alternative  to  programming  the 
machine  by  hand  to  solve  every  detail  of  a complex  problem. 

In  summary,  X believe  that  what  A. I.  needs  is  a truly 


' 


automatic  way  of  generating  a computer  program.  When  the 
day  comes  when  we  can  train  the  machine , rather  than  program 
it,  then  A. I.  will  become  a practical  tool  rather  than  a 
research  effort. 
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